Metaheuristics Optimization with Deep Learning Enabled Automated Image Captioning System
نویسندگان
چکیده
Image captioning is a popular topic in the domains of computer vision and natural language processing (NLP). Recent advancements deep learning (DL) models have enabled improvement overall performance image approach. This study develops metaheuristic optimization with learning-enabled automated technique (MODLE-AICT). The proposed MODLE-AICT model focuses on generation effective captions to input images by using two processes involving encoding unit decoding unit. Initially, at part, salp swarm algorithm (SSA), HybridNet model, utilized generate effectual representation fixed-length vectors, showing novelty work. Moreover, part includes bidirectional gated recurrent (BiGRU) used descriptive sentences. inclusion an SSA-based hyperparameter optimizer helps attaining performance. For inspecting enhanced series simulations were carried out, results are examined under several aspects. experimental values suggested betterment over recent approaches.
منابع مشابه
Deep Learning for Automatic Image Captioning in Poor Training Conditions
English. Recent advancements in Deep Learning show that the combination of Convolutional Neural Networks and Recurrent Neural Networks enables the definition of very effective methods for the automatic captioning of images. Unfortunately, this straightforward result requires the existence of large-scale corpora and they are not available for many languages. This paper describes a simple methodo...
متن کاملLearning to Evaluate Image Captioning
Evaluation metrics for image captioning face two challenges. Firstly, commonly used metrics such as CIDEr, METEOR, ROUGE and BLEU often do not correlate well with human judgments. Secondly, each metric has well known blind spots to pathological caption constructions, and rulebased metrics lack provisions to repair such blind spots once identified. For example, the newly proposed SPICE correlate...
متن کاملContrastive Learning for Image Captioning
Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of captions, as distinctive captions are more likely to describe images with their unique aspects. In this work, we propose a new learning method, Contrastive Learn...
متن کاملDeep Learning for Video Classification and Captioning
Accelerated by the tremendous increase in Internet bandwidth and storage space, video data has been generated, published and spread explosively, becoming an indispensable part of today's big data. In this paper, we focus on reviewing two lines of research aiming to stimulate the comprehension of videos with deep learning: video classification and video captioning. While video classification con...
متن کاملStack-Captioning: Coarse-to-Fine Learning for Image Captioning
The existing image captioning approaches typically train a one-stage sentence decoder, which is difficult to generate rich fine-grained descriptions. On the other hand, multi-stage image caption model is hard to train due to the vanishing gradient problem. In this paper, we propose a coarse-to-fine multistage prediction framework for image captioning, composed of multiple decoders each of which...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2022
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app12157724